fix(test): Disables spotlight for sample app#5266
Conversation
Android (legacy) Performance metrics 🚀
|
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| ba75c7c | 367.72 ms | 369.16 ms | 1.44 ms |
| 459a438+dirty | 417.09 ms | 406.52 ms | -10.57 ms |
| d751a5d+dirty | 434.24 ms | 486.08 ms | 51.84 ms |
| 2adbd1e+dirty | 433.98 ms | 427.96 ms | -6.02 ms |
| 23080e5 | 384.85 ms | 382.57 ms | -2.28 ms |
| 20daa0a | 359.51 ms | 374.90 ms | 15.39 ms |
| af9331b | 449.77 ms | 479.20 ms | 29.43 ms |
| 161947d+dirty | 393.26 ms | 403.00 ms | 9.74 ms |
| 64cd15c | 439.02 ms | 427.63 ms | -11.39 ms |
| 77061ed+dirty | 369.55 ms | 408.35 ms | 38.80 ms |
App size
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| ba75c7c | 17.75 MiB | 20.15 MiB | 2.41 MiB |
| 459a438+dirty | 17.75 MiB | 19.70 MiB | 1.95 MiB |
| d751a5d+dirty | 17.75 MiB | 19.68 MiB | 1.94 MiB |
| 2adbd1e+dirty | 17.75 MiB | 19.70 MiB | 1.96 MiB |
| 23080e5 | 17.75 MiB | 19.68 MiB | 1.94 MiB |
| 20daa0a | 17.75 MiB | 20.15 MiB | 2.41 MiB |
| af9331b | 17.75 MiB | 19.68 MiB | 1.94 MiB |
| 161947d+dirty | 17.75 MiB | 19.70 MiB | 1.95 MiB |
| 64cd15c | 17.75 MiB | 20.15 MiB | 2.41 MiB |
| 77061ed+dirty | 17.75 MiB | 19.68 MiB | 1.94 MiB |
Previous results on branch: antonis/fix-captureSpaceflightNews-article-spans
Startup times
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 24a5a84+dirty | 400.29 ms | 394.81 ms | -5.48 ms |
| e20920d+dirty | 376.02 ms | 373.11 ms | -2.91 ms |
| fd93bb6+dirty | 423.92 ms | 422.38 ms | -1.54 ms |
App size
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 24a5a84+dirty | 17.75 MiB | 19.70 MiB | 1.95 MiB |
| e20920d+dirty | 17.75 MiB | 19.70 MiB | 1.96 MiB |
| fd93bb6+dirty | 17.75 MiB | 19.70 MiB | 1.95 MiB |
|
@lucas-zimerman I think the new spans are related to the consoleLoggingIntegration. If that is the case do we need any other modifications or fixing the tests is enough? |
Android (new) Performance metrics 🚀
|
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 459a438+dirty | 359.50 ms | 390.53 ms | 31.03 ms |
| 5526494+dirty | 380.79 ms | 432.70 ms | 51.91 ms |
| d751a5d+dirty | 341.61 ms | 403.06 ms | 61.45 ms |
| 2adbd1e+dirty | 366.13 ms | 419.49 ms | 53.36 ms |
| 161947d+dirty | 349.27 ms | 435.09 ms | 85.82 ms |
| 77061ed+dirty | 359.40 ms | 424.10 ms | 64.70 ms |
| bfe454a+dirty | 372.42 ms | 424.52 ms | 52.10 ms |
| c1573b3+dirty | 355.65 ms | 448.82 ms | 93.17 ms |
| af9331b+dirty | 374.42 ms | 425.68 ms | 51.26 ms |
| 23080e5+dirty | 347.29 ms | 381.87 ms | 34.58 ms |
App size
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 459a438+dirty | 7.15 MiB | 8.42 MiB | 1.27 MiB |
| 5526494+dirty | 7.15 MiB | 8.41 MiB | 1.26 MiB |
| d751a5d+dirty | 7.15 MiB | 8.41 MiB | 1.26 MiB |
| 2adbd1e+dirty | 7.15 MiB | 8.43 MiB | 1.28 MiB |
| 161947d+dirty | 7.15 MiB | 8.43 MiB | 1.28 MiB |
| 77061ed+dirty | 7.15 MiB | 8.41 MiB | 1.26 MiB |
| bfe454a+dirty | 7.15 MiB | 8.42 MiB | 1.26 MiB |
| c1573b3+dirty | 7.15 MiB | 8.42 MiB | 1.27 MiB |
| af9331b+dirty | 7.15 MiB | 8.41 MiB | 1.26 MiB |
| 23080e5+dirty | 7.15 MiB | 8.41 MiB | 1.26 MiB |
Previous results on branch: antonis/fix-captureSpaceflightNews-article-spans
Startup times
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 24a5a84+dirty | 325.32 ms | 361.80 ms | 36.48 ms |
| e20920d+dirty | 382.33 ms | 435.17 ms | 52.83 ms |
| fd93bb6+dirty | 369.69 ms | 375.85 ms | 6.15 ms |
App size
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 24a5a84+dirty | 7.15 MiB | 8.43 MiB | 1.28 MiB |
| e20920d+dirty | 7.15 MiB | 8.43 MiB | 1.28 MiB |
| fd93bb6+dirty | 7.15 MiB | 8.43 MiB | 1.28 MiB |
iOS (legacy) Performance metrics 🚀
|
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 0b64753+dirty | 1232.49 ms | 1226.96 ms | -5.53 ms |
| 93137d1+dirty | 1230.73 ms | 1230.98 ms | 0.25 ms |
| 7480abe+dirty | 1220.53 ms | 1244.18 ms | 23.65 ms |
| 23080e5+dirty | 1216.02 ms | 1224.94 ms | 8.91 ms |
| 3bd3f0d+dirty | 1231.51 ms | 1229.10 ms | -2.41 ms |
| 59f3a84+dirty | 1232.56 ms | 1238.12 ms | 5.56 ms |
| eb07ba3+dirty | 1222.46 ms | 1220.37 ms | -2.08 ms |
| 6479fd5+dirty | 1228.48 ms | 1231.32 ms | 2.84 ms |
| c7f264b+dirty | 1211.82 ms | 1218.04 ms | 6.22 ms |
| ba75c7c+dirty | 1235.86 ms | 1226.45 ms | -9.41 ms |
App size
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 0b64753+dirty | 2.63 MiB | 3.98 MiB | 1.35 MiB |
| 93137d1+dirty | 2.63 MiB | 3.99 MiB | 1.35 MiB |
| 7480abe+dirty | 2.63 MiB | 3.96 MiB | 1.33 MiB |
| 23080e5+dirty | 2.63 MiB | 3.91 MiB | 1.28 MiB |
| 3bd3f0d+dirty | 2.63 MiB | 3.99 MiB | 1.35 MiB |
| 59f3a84+dirty | 2.63 MiB | 3.99 MiB | 1.36 MiB |
| eb07ba3+dirty | 2.63 MiB | 3.81 MiB | 1.18 MiB |
| 6479fd5+dirty | 2.63 MiB | 3.96 MiB | 1.33 MiB |
| c7f264b+dirty | 2.63 MiB | 3.91 MiB | 1.28 MiB |
| ba75c7c+dirty | 2.63 MiB | 3.81 MiB | 1.18 MiB |
Previous results on branch: antonis/fix-captureSpaceflightNews-article-spans
Startup times
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| e20920d+dirty | 1225.78 ms | 1235.38 ms | 9.60 ms |
| 24a5a84+dirty | 1233.33 ms | 1239.04 ms | 5.72 ms |
| fd93bb6+dirty | 1221.60 ms | 1242.33 ms | 20.73 ms |
App size
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| e20920d+dirty | 2.63 MiB | 4.00 MiB | 1.36 MiB |
| 24a5a84+dirty | 2.63 MiB | 3.99 MiB | 1.36 MiB |
| fd93bb6+dirty | 2.63 MiB | 4.00 MiB | 1.36 MiB |
iOS (new) Performance metrics 🚀
|
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 0b64753+dirty | 1225.77 ms | 1232.98 ms | 7.21 ms |
| 93137d1+dirty | 1232.69 ms | 1245.18 ms | 12.49 ms |
| 7480abe+dirty | 1219.84 ms | 1223.60 ms | 3.76 ms |
| 23080e5+dirty | 1221.39 ms | 1222.08 ms | 0.70 ms |
| 3bd3f0d+dirty | 1230.18 ms | 1243.41 ms | 13.22 ms |
| 59f3a84+dirty | 1205.09 ms | 1213.31 ms | 8.23 ms |
| eb07ba3+dirty | 1214.49 ms | 1221.59 ms | 7.10 ms |
| 6479fd5+dirty | 1207.80 ms | 1215.12 ms | 7.32 ms |
| c7f264b+dirty | 1229.78 ms | 1225.84 ms | -3.94 ms |
| ba75c7c+dirty | 1236.14 ms | 1240.69 ms | 4.55 ms |
App size
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| 0b64753+dirty | 3.19 MiB | 4.55 MiB | 1.36 MiB |
| 93137d1+dirty | 3.19 MiB | 4.55 MiB | 1.37 MiB |
| 7480abe+dirty | 3.19 MiB | 4.53 MiB | 1.35 MiB |
| 23080e5+dirty | 3.19 MiB | 4.48 MiB | 1.29 MiB |
| 3bd3f0d+dirty | 3.19 MiB | 4.55 MiB | 1.37 MiB |
| 59f3a84+dirty | 3.19 MiB | 4.56 MiB | 1.37 MiB |
| eb07ba3+dirty | 3.19 MiB | 4.38 MiB | 1.19 MiB |
| 6479fd5+dirty | 3.19 MiB | 4.53 MiB | 1.35 MiB |
| c7f264b+dirty | 3.19 MiB | 4.48 MiB | 1.29 MiB |
| ba75c7c+dirty | 3.19 MiB | 4.38 MiB | 1.19 MiB |
Previous results on branch: antonis/fix-captureSpaceflightNews-article-spans
Startup times
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| e20920d+dirty | 1233.86 ms | 1233.58 ms | -0.27 ms |
| 24a5a84+dirty | 1234.16 ms | 1232.79 ms | -1.38 ms |
| fd93bb6+dirty | 1213.04 ms | 1215.31 ms | 2.27 ms |
App size
| Revision | Plain | With Sentry | Diff |
|---|---|---|---|
| e20920d+dirty | 3.19 MiB | 4.56 MiB | 1.38 MiB |
| 24a5a84+dirty | 3.19 MiB | 4.56 MiB | 1.37 MiB |
| fd93bb6+dirty | 3.19 MiB | 4.56 MiB | 1.38 MiB |
That's the spotlight URL, we are probably instrumenting requests being sent to spotlight :O |
Good point @lucas-zimerman 👍 I haven't figured out why this started now 🤔 |
Can we disable spotlight there? |
Testing this with ba431c6 🤞 |
|
The api we are using seems to not be available at this point. I'll retest tomorrow |
Disabling spotlight seems to be working. Thank you @lucas-zimerman 🙇 |
📢 Type of change
📜 Description
Fixes
contains exactly two articles requests spanstest failure💡 Motivation and Context
Consistent test failure (example) due to the
localhostrequest spans💚 How did you test it?
CI
📝 Checklist
sendDefaultPIIis enabled🔮 Next steps
#skip-changelog